Entropy production in the majority-vote model 
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We analyzed the entropy production in the majority-vote model by using a mean-field approxima- 
tion and Monte Carlo simulations. The dynamical rules of the model do not obey detailed balance 
so that entropy is continuously being produced. This nonequilibrium stochastic model is known 
to have a critical behavior belonging to the universality class of the equilibrium Ising model. We 
show that the entropy production also exhibits a singularity at the critical point similar to the one 
occurring in the entropy, or the energy, of the equilibrium Ising model. 
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I. INTRODUCTION 

Irreversible systems in the stationary state are in a 
process of continuous production of entropy. In systems, 
like the one studied here, governed by a master equation, 
that is, defined by a continuous time Markov process, 
the irreversibility is characterized by the lack of detailed 
balance. When a system governed by a Markov process 
is reversible, that is, when the dynamic rules are such 
that detailed balance is obeyed, the production of entropy 
vanishes at the equilibrium state. This is indeed the case 
of the Glauber model and any other dynamics used to 
simulate the equilibrium Ising model. The production of 
entropy is then a signature of irreversibility. 

The rate of change of the entropy S of a system can 
be properly decomposed into two contributions 



dS TT * 



(1) 



where II is the entropy production due to irreversible pro- 
cesses occurring inside the system and $ is the entropy 
flux from the system to the environment. The quantity 
LT is positive definite whereas $ can have either sign. In 
the stationary state the entropy S of the system remains 
constant so that $ = II. Notice that the quantity $ is 
defined here as the flux from inside to outside the system. 
So that, it will be positive in the stationary state. 

In this work we study the steady state production of 
entropy in a nonequilibrium lattice model, namely, the 
majority- vote model 0- C3- d • This is a polling model 
in which individuals in a community take the opinion 
of their neighbors with a certain probability p and the 
opposite opinion with probability q = 1 — p. In two or 
more dimensions, this model displays a continuous phase 
transition described by the same critical exponents as 
the equilibrium Ising model This is in agreement 
with the conjecture by Grinstein et al. |5| according to 
which nonequilibrium stochastic systems with up-down 
symmetry fall in the universality class of the equilibrium 
Ising model. 

The flux of entropy is determined by means of an ex- 
pression which is the average of a function of the rates 
of transition from one state to another and its reverse 



0- 0- EI Il8j - As the entropy production equals the 
entropy flux in the stationary state, the former can be 
determined from the expression for the latter. We use 
mean-field and Monte Carlo simulations to calculate the 
entropy flux. In the stationary regime, and at the crit- 
ical point, the entropy flux, or cquivalentlythe entropy 
production, displays a singularity which we assume to 
be the same singularity occurring in the entropy of the 
equilibrium Ising model. 

II. ENTROPY PRODUCTION 

Let us consider a system described by a continuous 
Markov process with stochastic variables defined over the 
sites of a regular lattice. A configuration of the system is 
denoted by a — (oi, 02, ■ ■ • , o~n) where TV is the number 
of sites of the lattice and Oj = ±1 is the spin variable 
associated to site i. We will be concerned only with one 
spin flip dynamics, defined by a transition rate lUj(a') in 
which the spin variable cr, changes its sign. The time 
evolution of the probability P(a, t) is governed by the 
master equation, 



dt 



P(a, t) = J2{Mv l )P(°\ t) - Wi(a)P(a, t)}, (2) 



where a 1 = (cti, cr 2 , ■ ■ ■ , -o'i, f jv)- 

The Gibbs entropy S(t) of the system at time t is de- 
fined by 



S(t)=-Y,P(a,t)hiP(<r,t). 



(3) 



Using the master equation , its time derivative can be 
written as 



P{a,t) 



x {w l (a t )P(a\t) - Wi (a)P(a,t)}. 



(4) 



In agreement with Eq. QJ, the righ-hand side of this 
expression should be decomposed into two terms, the en- 
tropy production II and the entropy flux $. These two 
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quantities have the following expressions [ESSE! 



n 



Wi(a)P(a, t) 



x{w l (a*)P(<j\t)-w l (<j)P(a,t)}, 



and 



w i (cr' 1 ) ' 



(5) 



(0) 



The right-hand side of Eq. JSJ is always positive as can 
be easily proved, and the right-hand side of Eq. JJjJl can 
be written as the average over the stationary probability 
distribution, that is, 



Wi(a l ) 



(7) 



This is a particularly useful equation because it can be 
employed to estimate $ from a Monte Carlo simulation. 
As it is well known only quantities that can be written as 
averages can be determined numerically in a Monte Carlo 
simulation. In this sense it is not possible to determine 
S given by Eq. Q nor II, given by Eq. JSJ), but it 
is actually possible to determine $ from Eq. ©. We 
remark finally that in the steady state II — <I> so that it 
is possible to determine the entropy production in this 
regime by a Monte Carlo simulation. 



III. MAJORITY- VOTE MODEL 

The majority-vote model is a one-spin flip stochastic 
dynamics defined by the following transition rate 



Wi{a) 



>)}, 



(8) 



where J-(x) is a function that equals —1, or +1 ac- 
cording to whether x < 0, x — or x > 0, and the 
summation is over the nearest neighbor sites of site i. 
Notice that the transition rate Wi(a) has the up-down 
symmetry, that is, it is invariant under the sign change 
of all spin variables cr.;. At each time interval, a site i 
is chosen at random. If the majority of the neighbors 
are in state +1(— 1) then the site takes the value +1(— 1) 
with probability p and the opposite sign with probability 
q = 1 — p where p = (1 + 7)/2. We will restrict our- 
selves to the case 0<<7<l/2so that 1 > 7 > 0. The 
model can also be interpreted as an Ising system in con- 
tact with two heat reservoir at temperatures + and 0~. 
Putting it in a different way, one reservoir always pro- 
vides energy and the other takes it away. Spin systems 
in contact with two heat baths at different temperatures 
[lilllllllSQHEIIimare perhaps the simplest 



models with nonequilibrium steady states exhibiting dy- 
namic phase transitions. 

In the stationary regime, the present model displays a 
continuous phase transition from an ordered (ferromag- 
netic) state to a disordered (paramagnetic) state . On 
a square lattice it is found by numerical simulation that 
the critical point occurs at q c — 0.075(1) :4]. The or- 
dered state occurs when < q < q c and the disordered 
state when q c < q < 1/2. For < q < 1/2, this model 
does not obey detailed balance and we expect a strictly 
positive entropy production. When q = 1/2 the system 
is completely disordered and corresponds to a reversible 
system so that the entropy production vanishes in this 
case. The critical behavior Q puts this model in the 
same universality class as the equilibrium Ising model. 
This result comes from the conjecture by Grinstein et 
al. [5j which states that models with stochastic evolu- 
tion rules with up-down symmetry belongs to the Ising 
universality class. 

From the transition rate Wi(a) given by Eq. JSJ) it is 
straightforward to show that 

Bl (a) = In = fin «) a^(]T a i+s ). (9) 

W l ((J l ) \ pj ^ 

Therefore, the entropy flux per site <f> — $/N for the 
majority-vote model can be determined as the average 

<f>=(B i (a)w i (a)). (10) 

Notice that for a square lattice the function !F{x) reads 

J r (CTi+CT 2 +CT 3 +CT 4 ) = - (<7i+ (72+0-3 +CT4) (3- CTi Cr 2 O-3C4 )• 
o 

(11) 

IV. MEAN-FIELD RESULTS 

From the master equation we get the following equa- 
tions for the time evolution of the magnetization (<Ji) 



— (oi) = -2(aiWi(a)}. 



(12) 



In the first order dynamic mean-field approximation, 
or simple mean-field approximation, the correlations are 
neglected and we need only this equation. We apply the 
approximation to the case of a regular lattice of coordi- 
nation four. In the stationary state, the magnetization 
m = (a) is given by the equation 



— m(3 — to 2 ). 
2 v ' 



(13) 



Using this approximation, we derive the following expres- 
sion for the entropy flux 

<j)= (ln-^j {i(3m 2 -TO 4 )-^(5 + 6TO 2 -3m 4 )}. (14) 
\ p J 4 16 
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FIG. 1: Entropy flux cj> for the majority- vote model in the 
simple mean-field approximation as a function of the external 
parameter q. The dotted line indicates the position of the 
critical point occurring at q c — 1/6. 



FIG. 2: Stationary entropy flux <j> for the majority vote model 
by Monte Carlo simulation as a function of the external pa- 
rameter q for various values of the system size L. The dotted 
line indicates the position of the critical point occurring at 
q c = 0.075. 



The paramagnetic solution, m — 0, gives the following 
expression for the entropy flux in the paramagnetic phase 



(15) 



The ferromagnetic solution is given by the expression 



m 



l-6q 
l-2q' 



(16) 



which is valid for q < q c — 1/6. From this result it follows 
that the entropy flux in the ferromagnetic state is 



1 - 2q 



9 



(17) 



The stationary entropy flux, or equivalently the entropy 
production, is a continuous function of the parameter q 
as shown in Fig. 1. At the critical point it presents a 
singularity represented in this mean-field approximation 
by a discontinuity in the first derivative. 



V. NUMERICAL SIMULATIONS 

We have simulated the majority- vote model on a 
square lattice with periodic boundary conditions for dif- 
ferent values of the size N = L x L of the system. The 
simulation was performed as follows. At each time step 
a site is chosen at random. It takes the value of the ma- 
jority sign of its neighbors with probability p = 1 — q 
and the opposite sign with probability q in accordance 
with the prescription given by Eq. (JSJ. After discard- 
ing the first Monte Carlo steps the stationary properties 
are calculated. We used from 10 6 to 10 7 Monte Carlo 
steps to calculate the averages such as the flux <f> given 
by Eq. l|lUfl . The magnetization and other quantities 
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FIG. 3: Enlargement of Fig. 2 around the critical point. 



such as the susceptibility have already been determined 
by Monte Carlo simulations 3 and will not concern us 
here. It is found that a continuous phase transition takes 
place at q c = 0.075(1) and that the critical exponents are 
the same as those of the two-dimensional Ising model . 

In Fig. 2 we show the numerical results for the en- 
tropy flux <j) for several values of the size of the system 
L. The entropy flux is finite and continuous. It has a 
maximum and vanishes when q — > 1/2 and when q — > 
as expected since in these two limits the system reaches 
an equilibrium stationary state. When g -> l/2wc found 
numerically that the flux vanishes according to 



4> = Kn ~<lf 



(18) 



with b = 0.190(3) and when q — > 0, it vanishes according 
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FIG. 4: Derivative d(f>/dq of the entropy flux (j> with respect 
to the external parameter q for several values of the system 
size L. The dotted line indicates the position of the critical 
point occurring at q c = 0.075. 



to 



= aq In 



1-g 

7 

q 



(19) 



with a = 1.83(5). 

We remark that the critical point does not correspond 
to the maximum of <f>. Actually, it corresponds to the 
point of inflexion occurring just before the maximum as 
can be seen in Fig. 3. At the critical point the flux is 
finite but has a singularity which we assume to be the 
same type as that of the energy or the entropy of the 
equilibrium Ising model, namely, of the form 



A±\q- q c 



(20) 



where <p c is the value of the entropy flux at the critical 
point. The amplitudes A + and A_ correspond to the 
regimes below (q < q c ) and above (q > q c ) the critical 
point. 

The energy of the equilibrium Ising model is related to 
the short range correlations of the even type. From Eqs. 
© and HI U| l and the result given by Eq. I|ll|) we see that 
the entropy flux is also related to the short range cor- 
relations of the even type: {<Ji<Jj) and {uiUjUkag) where 
k and I are nearest and next-nearest neighbor sites. 
We expect, therefore, that the critical behavior of the en- 
tropy flux of nonequilibrium models with up-down sym- 
metry and the critical behavior of energy of the equi- 
librium Ising model are described by the same critical 
exponent. 

To determine the critical behavior it is convenient to 
study the derivative of the entropy flux with respect to 
the external parameter q which, as follows from Eq. 1)20(1 . 
behaves as 



dq 



(21) 



FIG. 5: Maximum of the derivative d<j>/dq of the entropy flux 
cj> with respect to the external parameter q as a function of 
the logarithm of the system size L. 



The exponent a is the same exponent related to the spe- 
cific heat of the equilibrium Ising model. Since, for the 
square lattice, the singularity is of the logarithm (a = 0) 
type then we assume that for the present two-dimensional 
majority-vote model 



dq 



\\n\q- 



(22) 



To test the assumption given by Eq. (1221 we have 
numerically determined d<fi/dq for several lattice sizes L 
as shown in Fig. 4. Using a finite-size scaling theory [lfij . 
then this quantity as a function of L should diverges as 
InL at the critical point and a similar behavior at the 
maximum, that is, 



d<f> 
dq 



InL. 



(23) 



From Fig. 5 we see that this behavior is indeed followed 
when L > 20. 



VI. CONCLUSION 

We have determined by mean-field approximation and 
by Monte Carlo simulations the stationary entropy pro- 
duction of a nonequilibrium model with up-down symme- 
try, namely, the majority-vote model. The calculation of 
this quantity by means of Monte Carlo simulations was 
possible because it equals the entropy flux, in the sta- 
tionary state, and so this quantity can be written as an 
average over a stationary probability distribution. The 
mean-field analysis as well as the Monte Carlo simula- 
tions show that the stationary entropy production is pos- 
itive for nonequilibrium situation, it vanishes when the 
system attains an equilibrium stationary state, and ex- 
hibits a singularity at the critical point. The mean-field 
results gives a singularity represented by a discontinuous 



first derivative as usually happens in mean-field calcula- 
tions of the energy as a function of temperature in equi- 
librium spin models. The Monte Carlo data, analyzed by 
a finite-size scaling theory, have shown that the station- 
ary entropy production has the same singular behavior at 
the critical point as the energy of the equilibrium Ising 
model. In the present case, namely, the model defined 
on a square lattice, the singularity of the derivative of 
the entropy production is characterized by a logarithmic 
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divergence. 
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